18.05 Lecture 7 
February 18, 2005 



Bayes' Formula. 
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Partition Bi,...,Bk 

Uti B^ = S,B,n Bj = for i ^ j 

HA) = E^=i n^Bi) = E-=i P(A|Bi)P(Si) - total probability. 



Example: In box 1, there arc 60 short bolts and 40 long bolts. In box 2, 

there are 10 short bolts and 20 long bolts. Take a box at random, and pick a bolt. 

What is the probability that you chose a short bolt? 

Bi = choose Box 1. 

B2 = choose Box 2. 

P(s/iort) = P(s/iortiSi)P(Bi) +P(s/iorf|B2)P(-B2) = ^{\) + ^{\) 
Example: 

Partitions: Bi,B2, ...Bfc and you know the distribution. 

Events: A, A, A and you know the P(A) for each Bi 

If you know that A happened, what is the probability that it came from a particular B^? 

HBiA) F(A\B,)¥(B,) „ , _ 

ViBAA) = l/^^ ' = — — — , , V I V y — ^ . Bayes's Formula 

^ " ' V{A) ¥{A\Bi)F{Bi) + ...+P{A\Bk)F{Bk) ^ 

Example: Medical detection test, 90% accurate. 

Partition - you have the disease (-Bi), you don't have the disease {B2) 

The accuracy means, in terms of probability: P(positive|Bi) = 0.9, P(positive|S2) = 0.1 

In the general public, the chance of getting the disease is 1 in 10,000. 

In terms of probability: F{Bi) = 0.0001, P(i32) = 0.9999 

If the result comes up positive, what is the probability that you actually have the disease? P(i?i|positive)? 

, , P(positivc|Bi)P(Bi) 

P(Bi I positive) = I 1; V 17 



P(positive|Si)P(Si) + P(positive|B2)P(B2) 



(0.9)(0.0001) 

^ ' =0.0009 



(0.9)(0.0001) + (0.1)(0.9999) 
The probability is still very small that you actually have the disease. 
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Example: Identify the source of a defective; item. 

There are 3 machines: Mi,M2,Mz. P(defective) : 0.01, 0.02, 0.03, respectively. 
The percent of items made that come from each machine is: 20%, 30%, and 50%, respectively. 
Probability that the item comes from a machine: P(Mi) = 0.2, P(M2) = 0.3, P{M'i) = 0.5 
Probability that a machine's item is defective: P{D\Mi) = 0.01, P(L'|M2) = 0.02, P(L>|M3) = 0.03 
Probability that it came from Machine 1: 



P(Mi|£>) 



P(D|Mi)P(Mi) 



P{D\M^)P{Mx) + P{D\M2)P{M2) + P{D\Ms)P{M\Z) 



(0.01)(0.2) 



(0.01)(0.2) + (0.02)(0.3) + (0.03)(0.5) 



= 0.087 



Example: A gene has 2 alleles: A, a. The gene exhibits itself through a trait with two versions. 

The possible phenotypes are "dominant," with genotypes AA or Aa, and "recessive," with genotype aa. 

Alleles travel independently, derived from a parent's genotype. 

In a population, the probability of having a particular allele: P(A) = 0.5, P(a) = 0.5 
Therefore, the probabilities of the genotypes are: P(AA) = 0.25, P(Aa) = 0.5,P(aa) 0.25 
Partitions: genotypes of parents: (AA, AA), (AA, Aa), (AA, aa), (Aa, Aa), (Aa, aa), (aa, aa). 
Assume pairs match regardless of genotype. 



Parent genotypes 


Probabilities 


Probability that child has dominant phenotype 


(AA, AA) 


1 

16 


1 


(AA, Aa) 


2x(i)(^) = f 


1 


(AA, aa) 


2x(i)(i) = i 


1 


(Aa, Aa) 


{m) = i 


3 
4 


(Aa, aa) 


2x(i)(i) = i 


1 

2 




Tfi 






If you see that a person has dark hair, predict the genotypes of the parents: 



P{{AA,AA)\A) 



1 X 



16 



1 

12 



You can do the same computation to find the probabilities of each type of couple. 
Bayes's formula gives a prediction inside the parents that you aren't able to directly see. 



Example;: You have 1 machine. 

In good condition: defective items only produced 1% of the time. P(in good condition) 
In broken condition: defective items produced 40% of the time. P (broken) = 10% 
Sample 6 items, and find that 2 are defective. Is the machine broken? 
This is very similar to the medical example worked earlier in lecture: 
P (good 1 2 out of 6 are defective) = 

P{2of&\good)P{good) 



90% 



P{2of&\good)P{good) + P{2ofQ\hroken)P {broken) 
©(0.01)2(0.99)4(0.9) 



(^) (0.01)2(0.99)4(0.9) + (^) (0.4)2(0.6)4(0.1) 



0.04 



End of Lecture 7 
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